@jthorton are you still keen on this PR? If so the tests are failing on formatting -- would you mind having a look at that?

Pinging @fjclark and @JMorado too in case you would find this useful -- otherwise I'll plan to close this PR, as we are planning to build our own distributed compute system in dimsim.

I’m not planning on using this PR for now. I think it would be useful in the future to have a wider range of closures that are more memory-efficient. For example, I’m currently using the energies target, and using a default_closure that resorts to its predict function processes one entry at a time (an entry can hold multiple configs). This is fine for a default_closure and possibly the most performant option for small systems, but for larger systems it is virtually impossible to hold the complete graph for an entry in memory without running into OOM issues. My solution has been to code bespoke closures outside descent, which works just fine, but we might want to discuss whether it would be useful to provide some memory-efficient closures within the package itself.

Ok, thanks @JMorado! In that case I'll close this PR for now and we can reopen the discussion when memory becomes more of an issue.